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^ ; ABSTRACT 

f| i We use a frequentist statistical approach to set confidence intervals on the values of 

Qh' cosmological parameters using the MAXIMA- 1 and COBE measurements of the an- 

JL. , gular power spectrum of the cosmic microwave background. We define a A^^ statistic, 

5_, ■ simulate the measurements of MAXIMA-1 and COBE, determine the probability dis- 

I tribution of the statistic, and use it and the data to set confidence intervals on several 

^ . cosmological parameters. We compare the frequentist confidence intervals to Bayesian 

' credible regions. The frequentist and Bayesian approaches give best estimates for the 

!^ \ parameters that agree within 15%, and confidence interval-widths that agree within 

^ . 30%. The results also suggest that a frequentist analysis gives slightly broader con- 

' fidence intervals than a Bayesian analysis. The frequentist analysis gives values of 

; ^ = 0.89+°-Jg, Ob/i^ = 0.026 n = 1.02+° i^J, and the Bayesian analysis 

gives values of = 0.98+°;Jg, n^ih'^ = 0.029 and n = l.lS^o;^!^, all at the 95% 
confidence level. 

Key words: cosmology: cosmic microwave background - methods: statistical - meth- 
ods: data analysis 



1 INTRODUCTION 

The angular power spectrum of the temperature anisotropy 
of the cosmic microwave background (CMB) depends on pa- 
rameters that determine the initial and evolutionary prop- 
erties of our universe. An accurate measurement of the 
power spectrum can provide strong constraints on these 
parameters. During the last few years several experiments 
have clearly measured the first peak in the power spectrum 
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(Hanany et al. 2000; de Bernardis el al. 2000; Miller et al. 
2001), at an angular scale of about 0.5 degree, and provided 
evidence for harmonic peaks at smaller angular scales (Lee 
et al. 2001; Netterfield et al. 2001; Halverson et al. 2001). 
Detailed analyses have yielded the values of the total energy 
density of the universe, the baryon density, the spectral in- 
dex of primordial fluctuations, and other parameters with 
unprecedented accuracy (Netterfield et al. 2001; Pryke et al. 
2001; Douspis, Barlett, & Blanchard 2001; Wang, Tegmark, 
& Zaidarriaga 2001; Stompor et al. 2001). 

Most CMB analyses to date have used a Bayesian sta- 
tistical approach to estimate the values of the cosmological 
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parameters. The results of these analyses can have consid- 
erable dependence on the priors assumed, (e.g., Bunn et al. 
1994; Lange et al. 2001; Jaffe et al. 2001), and it is there- 
fore instructive to attempt an estimate of the cosmological 
parameters that is independent of priors. 

Bayesian and frequentist methods for setting limits on 
parameters involve quite diflferent fundamental assumptions. 
In the Bayesian approach one attempts to determine the 
probability distribution of the parameters given the ob- 
served data. A Bayesian credible region for a parameter is 
a range of parameter values that encloses a fixed amount of 
this probability. In the frequentist approach, on the other 
hand, one computes the probability distribution of the data 
as a function of the parameters. A parameter value is ruled 
out if the probability of getting the observed data given this 
parameter is low. Because the questions asked in the two 
approaches are quite different, there is no guarantee that 
uncertainty intervals obtained by the two methods will co- 
incide. 

Frequentist analyses quantify the probability distribu- 
tion of the data in terms of a statistic that quantifies the 
goodness-of-fit of a model to the data. The maximum- 
likelihood estimator is probably the most widely used 
statistic. When the data are Gaussian-distributed and the 
model depends linearly on the parameters, the statistic is 
X^-distributed and standard x^ tables are used to determine 
confidence intervals (Press et al. 1992). 

It has become common to compare CMB data to the- 
oretical predictions via the angular power spectrum, which 
depends on a number of cosmological parameters. The data 
points arc usually the most likely levels of temperature fluc- 
tuation power C( within certain bands A(. of spherical har- 
monic multipolos. However, the band powers Ce are not 
Gaussian distributed (Bond, Jaffe, & Knox 2000), and the 
theoretical angular power spectrum does not depend lin- 
early on the cosmological parameters. Thus a statistic 
may not be x'^-distributcd. Furthermore, the complicated 
probability distribution of the data points and the depen- 
dence of the theoretical predictions on the parameter values 
make the analytic calculation of the probability distribution 
of impossible. Thus, there is no guidance on how to set 
frequentist confidence intervals. 

In the past, Gorski, Stompor & Juszkiewicz (1993) used 
a frequentist analysis to assess the probability of a standard 
CDM cosmological model given the data from the UCSB 
South Pole and COBE experiments (see also Stompor & 
Gorski, 1994). More recently, Padmanabhan & Sethi (2000), 
and Griffiths, Silk, & Zaroubi (2001) used a frequentist ap- 
proach to determine confidence intervals on several cosmo- 
logical parameters. These recent analyses (implicitly) as- 
sume that the band power Ci is Gaussian distributed and 
that the cosmological model is linear in the cosmological pa- 
rameters, and thus that standard x^ values can be used to 
set confidence intervals on various cosmological parameters. 
These analyses also do not account for correlations between 
between band powers. Gawiser (2001) argued that a frequen- 
tist analysis is better suited than Bayesian for answering the 
question of how consistent parameter estimates from CMB 
data arc with estimates from other astrophysical measure- 
ments. A method for estimating the angular power spectrum 
which uses frequentist considerations was presented in Hivon 
et al. (2001). 



In this paper we present a more rigorous approach to 
frequentist parameter estimation from CMB data than pre- 
vious analyses. We use the data from the COBE (Gorski et 
al. 1996) and MAXIMA-1 experiments (Hanany et al. 2000) 
and simulations to determine the probability distribution of 
an appropriate Ax^ statistic, and use this distribution to 
set frequentist confidence intervals on several cosmological 
parameters. We compare the frequentist confidence intervals 
to Bayesian credible regions obtained using the same data 
and to the likelihood-maximization results of Balbi et al. 
(2000). 

The structure of this paper is as follows: in Section 2 we 

discuss the MAXIMA-1 and COBE data and the database 
of cosmological models used in our analysis. In Section 3 we 
present the x^ statistic used in our analysis. Section 4 de- 
scribes the process of setting frequentist and Bayesian con- 
fidence regions on cosmological parameters. The results and 
a discussion are given in Sections 5 and 6. 



2 DATA AND DATABASE OF 
COSMOLOGICAL MODELS 

We use the angular power spectrum computed from the 5' 
MAXIMA-1 CMB temperature anisotropy map (Hanany et 
al. 2000) and the 4-year COBE angular power spectrum 
(Gorski et al. 1996). The MAXIMA-1 and COBE power 
spectra have 10 and 28 data points in the range 36 < < 785 
and 2 < £ < 35, respectively. Lee et al. (1999) and Hanany 
et al. (2000) provide more information about the MAXIMA 
experiment and data. Santos et al. (2001) and Wu et al. 
(2001a) showed that the temperature fluctuations in the 
MAXIMA-1 map are consistent with a Gaussian distribu- 
tion. Lee et al. (2001) have recently extended the analysis 
of the data from MAXIMA-1 to smaller angular scales, but 
these data are not used in this paper. 

To perform our analysis we constructed a database of 
330,000 inflationary cosmological models (Seljak & Zaldar- 
riaga 1996) that has the following cosmological parameter 
ranges and resolutions: 

• r = 0.0,0.1,0.2,0.3,0.4,0.5 

• Ob = 0.005, 0.01, 0.02, 0.03, 0.04, 0.05, 0.075, 0.10, 0.15 

• = 0.05, 0.1, 0.15, 0.2, 0.25, 0.3, 0.35, 0.4, 0.5, 0.6, 0.7, 

0.8,0.9,1.0 

• fiA = 0.0, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 1.0 

• Ho= 40, 50, 60, 70, 80, 90 

• n = 0.6, 0.7, 0.8, 0.9, 1.0, 1.1, 1.2, 1.3, 1.4, 1.5 

The parameter r is the optical depth to reionization, n is the 
scalar spectral index of the primordial power spectrum, and 
Ho is the Hubble parameter in units of kms~^ Mpc^^. The 
density parameters fls, f^M, and ft a give the ratios of the 
density of baryons, total matter, and cosmological constant 
to the critical density. 



3 THE x^ STATISTIC 

To set frequentist confidence intervals we choose the 
maximum-likelihood estimator x^ as a goodness-of-fit statis- 
tic. We use the x^ as defined in equation (39) of Bond, Jaffe, 
& Knox (2001, hereinafter BJK) 
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Figure 1. Distribution of values computed for the 10,000 
simulations by solving for J\f and u analytically using the method 
described in the text (dashed line), and numerically using Brent's 
root-finding algorithm (solid line). Both histograms have a bin 
size of one and are normalized to integrate to one. 



= Y.^zf-z\)u.Az^-z]) + ^^^^^ (1) 

Zl = \n{UCl + Xi) (2) 

Zf =\n{uCf + x^). (3) 

The sum in equation (1) includes the COBE and MAXIMA- 
1 bands. The data and theory band powers are denoted as 
Cf and C', respectively, Mij is the inverse covariance ma- 
trix for the Zf quantities, and M is the normalization of 
the models to the data [sometimes called Cio, e.g. Balbi et 
al. (2000)]. The variable u accounts for the calibration un- 
certainty of the MAXIMA-1 data, which is 8% in the power 
spectrum (Hanany et al. 2000), i.e. cr„ = 0.08. For the COBE 
bands u is defined to be one. 

Each time a is calculated we solve for the normal- 
ization N and calibration factor u that simultaneously min- 
imize x^- Because we did not find a closed-form analytical 
solution to the minimization of equation (1) with respect to 
J\f and u, and a numerical minimization would have been 
computationally prohibitive, we used the following approx- 
imation. We assume that equation (1) is well approximated 
by 

x' ~ y^iucf - NcDf.A'^ct - MCl) + (4) 

Where the Fisher matrix Fij for the Cf quantities, is related 
to Mij by 

M,, = F,,(Cf + xO(C/ + x,). (5) 

Minimization of equation (4) with respect to M and it gives 
two coupled equations which we solve for u by assuming 
that N = 1. We then use that value of u to solve for N ■ 
We compared this approximate solution to a rigorous nu- 
merical minimization of equation (1) for 10,000 cases and 
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Figure 2. The histogram gives the Ax^ distribution for the en- 
tire six-dimensional parameter space from 10,000 simulations of 
the COBE and MAXIMA-1 band powers. The dashed curve is 
the standard distribution for six degrees of freedom. The ver- 
tical solid line (vertical dashed line) is Ax^ = 16.5(12.8), which 
corresponds to the 95% Ax'^ threshold for the histogram (stan- 
dard x^ distribution). The histogram has a bin size of 0.5, and is 
normalized to integrate to one. 

found an RMS fractional error of less than 1.5% (see Fig- 
ure 1). Once the factors M and u have been determined 
using equation (4), the exact equation (1) is used to find the 
value of x^- 



4 DETERMINING CONFIDENCE LEVELS 

4.1 Frequentist Confidence Intervals 

Let a denote a vector of parameters in our six-dimensional 
parameter space, and atmo be the unknown true values of 
the cosmological parameters that we are trying to estimate. 
By minimizing x^ we find that the best-fitting model to 
the MAXIMA-1 and COBE data has the following param- 
eters ao: {Hq, f^B, ^M, f^A, n, r) = (60, .075, .7, .2, 1, 0). This 
model gives a x^ = 36, which is an excellent fit to 38 data 
points. We define 

Ax'(a) = x'(a)-x'(ao), (6) 

where the first term on the right hand side is a x^ of the data 
with a model in the database, and the second is a x^ of the 
data with the best-fitting model. To quantify the probabil- 
ity distribution of the data as a function of the parameters 
we choose a threshold Q, and define TZ to be the region in 
parameter space such that Ax'^ < O. 7^ is a confidence re- 
gion at level ct if there is a probability a that TZ contains the 
true cosmological parameters atrue- In other words, if many 
vectors ao(j) and regions IZj are generated by repeating the 
experiment many times, a fraction a of the ensemble of TZj 
would contain atruc- Since the Ax^ statistic may not be 
distributed, we use simulations to determine its probability 
distribution as a function of the cosmological parameters. 

The simulations mimic 10,000 independent observations 
of the CMB by the MAXIMA-1 and COBE experiments. 
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Figure 3. Simulated one-dimensional Ax^ distributions for all the parameters in the database. The vertical dotted lines correspond to 
the 95% Ax^ threshold level; numerical values are given in Table 1. Each histogram has a bin size of 0.05 and is normalized to integrate 
to one. The 95% threshold for a standard distribution with one degree of freedom is x^ = 3.8. 




Figure 4. Simulated two-dimensional Ax^ distributions in the (Hojf^B) and (£7Mif2A) planes. The vertical dotted lines correspond to 
the 95% Ax^ cutoff level, which are 6.25 and 7.70 for (Ho,Qb) and (f2M,f2A) respectively. Each histogram has a bin size of 0.05 and is 
normalized to integrate to one. The 95% threshold for a standard x^ distribution with two degrees of freedom is x^ = 6. 
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Figure 5. Ax^ calculated with the MAXIMA-1 and COBE data as a function of parameter value for each of the parameters in the 
database. Solid circles show grid points in parameter space, and the solid lines were obtained by interpolating between grid points. The 
parameter values where the solid line intercepts the dashed (dotted) line corresponds to the 68% (95%) frequentist confidence region. 



The CMB is assumed to be characterized by the MAXIMA- 
1 and COBE best estimate for the cosmological parame- 
ters, ao. Applying the equivalent of equation (6) [see equa- 
tions (7) and (8)] for each of the simulations gives a set of 
10,000 values Axf (j = 1,...,10'*), and by histogramming 
these values we associate threshold levels Q with probabil- 
ities a. This relation between Q and a is applied to the 
distribution of Ax'^ that is calculated using equation (6) to 
determine a frequentist confidence interval TZ on the cosmo- 
logical parameters. Note that our procedure assumes that 
the probability distribution of Ax'^ around ao closely mim- 
ics the probability distribution of Ax^ around atiuc- This is 
a standard assumption in frequentist analyses (Press et al. 
1992). The alternative approach of determining the proba- 
bility distribution around each grid point in parameter space 
is computationally prohibitive. 

Because finding the best-fitting band powers from a 
time stream or even a sky map is computationally expensive 
(Borrill 1999), we perform 10,000 simulations of the quan- 
tities Zf , which are related to the band powers Ci as de- 
fined in equation (3). We assume that the Zf are Gaussian- 
distributed (Bond, Jaffe, & Knox 2000) and we discuss and 
justify this assumption in Appendix A. 

The quantities Z^ -y where j denotes one of the 10,000 
simulations, are drawn from two multivariate Gaussian dis- 
tributions that represent the MAXIMA-1 (10 data points) 
and COBE (28 data points) band powers. The means of the 
distributions are the Z' quantities as determined by ao , and 
the covariances are taken from the data. Each of the Z^f^^-^ 



is thus a vector with 38 elements representing an indepen- 
dent observation of a universe with a set of cosmological 
parameters ao . We include uncertainty in the calibration 
and beam-size of the MAXIMA-1 experiment by multiplying 
the MAXIMA band-powers by two Gaussian random vari- 
ables. The calibration random variable has a mean of one 
and standard deviation of 0.08, and the beam-size random 
variable has a mean of one and a variance that is ^-dependent 
(Hanany et al. 2000; Wu et al. 2001b). For each simulation 
j the entire database of cosmological models is searched for 
the vector of parameters which minimizes , and we 
calculate Ax^: 



Ax? 



Xj(ao) 



Xj(ao{i)). 



(7) 



The first and second terms on the right hand side are the 
X^ of simulation j with the model ao, and of simulation j 
with its best-fitting model, respectively. A normalized his- 
togram of Axj for all 10,000 simulations is shown in Fig- 
ure 2 and gives the probability distribution of Ax^ over 
the six-dimensional parameter space. The 95% threshold is 
Ax'^ = 16.5, that is, 95% of the probability is contained in 
the range < Ax'^ < 16.5. Figure 2 also shows a standard 
X^— distribution with six degrees of freedom and its associ- 
ated 95% threshold level. The difference between the results 
of the simulations and the standard x^ distribution is at- 
tributed to the non-linear dependence of the models on the 
parameters and minimizing x^ over M and u. 

Contour levels in the six-dimensional parameter space 
that are provided by different thresholds of the distribution 
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Figure 6. Two-dimensional frequentist confidence regions in the 
(HmiSIa) plane. The red, orange, and yellow regions correspond 
to the 68%, 95%, and 99% confidence regions respectively. The 
dashed line corresponds to a flat universe, H = S^m + S7a = 1. 

of cannot be used to set confidence intervals on any in- 
dividual parameter. To find a confidence interval for a single 
parameter p we compute the probability distribution Ax(p) 
in the following way. We search the database for the model 
that minimizes the with simulation j under the condi- 
tion that p is fixed at its value in ao, and for the model that 
minimizes the with simulation j with no restrictions on 
the parameters. We compute 

AXb) = Xj (a(p)) - Xj(aoo)), (8) 

where a(p) is the vector of parameters that minimize sub- 
ject to the constraint that p is fixed. A histogram of Ax^p) 
provides the necessary distribution. The one-dimensional 
distributions for all six parameters in the database are 
shown in Figure 3. Generalization of this process for finding 
the probability distribution for any subset of parameters is 
straightforward. The two-dimensional Ax^ distributions in 
the {Ho,Q,^) and (f^MjSlA) planes are shown in Figure 4 
and the corresponding 95% thresholds are Ax'^ = 6.25 and 
Ax^ = 7.70, respectively. 

Using the simulated one- and two-dimensional proba- 
bility distributions of Ax^ we set 68% and 95% threshold 
levels on the distribution of Ax'^ that are calculated using 
the data and the database of models, i.e. the one calculated 
from equation (6), and we determine corresponding confi- 
dence intervals on the cosmological parameters. Figures 5, 
6, and 7 give the association between Ax'^ and cosmological 
parameter values for each of the parameters in the database 
and in the {Hq,^^) and (r2M,f^A) planes. 

4.2 Bayesian Credible Regions 

According to Bayes's theorem the probability of a model 
given the data, the posterior probability, is proportional to 
the product of the likelihood £ (a) = exp( — ix^(a)) and a 
prior probability distribution of the parameters. If the prior 
is constant, as we shall assume, then the posterior probabil- 




Figure 7. Two-dimensional frequentist confidence regions in the 
(-ffOi f^s) plane. The red, orange, and yellow regions correspond to 
the 68%, 95%, and 99% confidence regions respectively. Standard 
calculations from big bang nucleosynthesis and observations of 
D/H predict a 95% confidence region of n^h^ = 0.021 
(Cyburt, Fields, & Olive 2001a), indicated by the shaded region. 

ity is directly proportional to the likelihood function. To set 
a Bayesian credible region for any parameter or subset of 
parameters of interest we calculate the likelihood £(a) for 
all models in the database, assume a flat prior probability 
distribution for all parameters, and integrate the likelihood 
over the remaining parameters. The 95% credible region is 
the region that encloses 95% of the probability. The likeli- 
hood functions for each parameter in the database are shown 
in Figure 8. 



5 RESULTS 

The 95% frequentist confidence intervals and Bayesian cred- 
ible regions for each parameter in the database are given in 
Table 1 and Figure 9. 

We found that the optical depth to last scattering r was 
degenerate with other parameters in the database, mostly 
with the spectral index of the primordial power spectrum n. 
Because of this degeneracy the 95% confidence interval of r 
covers nearly the entire range of values considered, and the 
95% credible region is disjoint. 

The 95% confidence intervals and credible regions for 
Ho, fie, fiivi and f^A include most of the parameter val- 
ues because the angular power spectrum of the CMB is 
not very sensitive to any one of them alone. It is more 
sensitive to the combination Qsh^, and to the total en- 
ergy density parameter fl = Qm + ^a- To set confi- 
dence intervals and credible regions for these new pa- 
rameters we formed all possible combinations of f2 and 
JIb^^ in our database and binned them in the following 
bins for f^e/i^: {0.00500,0.0129,0.0207,0.0286,0.0364,0.0442, 
0.0521,0.0600}, and for Q: {0.25,0.35,0.45,0.55,0.65,0.75, 
0.85,0.95,1.05,1.15,1.25,1.35,1.45}. The center value in each 
bin is considered a new database grid point. We repeat the 
process used to find the 95% Ax^ threshold for Qsh^ and Q,, 
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Figure 8. Bayesian likelihood functions for each of the parameters in the database. Solid circles show grid points in parameter space, 
while the solid lines were obtained by interpolating between grid points. The parameter values where the solid line intercepts the dashed 
(dotted) line corresponds to the 68% (95%) Bayesian credible regions. 
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Figure 9. A comparison of the 95% frequentist confidence intervals (FCI, solid line), Bayesian credible regions (BCR, dashed line), and 
maximization regions (M, dashed dot line) for the parameters in the database, and for f2 and Q,^h^ . 
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95% Confidence Ref 


;ions 




Parameter 


^^(95%) 


frequentist 


Bayesian 


Balbi et al. 


Ho 


2.80 


[42,79] 


[41,79] 




n 


4.50 


[0.92,1.33] 


[0.95,1.28] 


[1.00,1.32] 




2.10 


[0.046,0.135] 


[0.052,0.146] 


— 


T 


2.45 


< 0.48=' 


— 


— 




3.40 


> 0.32=^ 


[0.37,0.95] 






3.40 


< 0.67*^ 


< 0.64=* 




n 


5.1 


[0.70,1.15] 


[0.79,1.12] 


[0.70,1.25] 




5.6 


[0.015,0.046] 


[0.019,0.044] 


[0.020,0.048] 



a: Sets only upper or lower limits on parameter 



Table 1. A comparison of Bayesian, frequentist and maximization 95% confidence intervals. The table also gives the 95% thresholds 
from the simulations. Maximization confidence intervals are taken from Balbi et al. (2000); they do not give confidence intervals for all 
the parameters. 



treating them as onc-dimcusional parameters. We also cal- 
culate the appropriate integrated Ukelihood functions. Table 
1 lists the 95% Ax^ threshold, confidence interval, and cred- 
ible regions for Q. and flnh^ ■ 

We determined the froquoutist and Bayesian central val- 
ues for n, Qsh^ and ft, the parameters to which the CMB 
power spectrum is most sensitive. In the frequentist ap- 
proach the central value of a parameter is the value given 
by the best-fitting model, and the Bayesian central value is 
the maximum marginalized likelihood parameter value. The 
frequentist and Bayesian analyses give respectively a value 
of ft = 0.89 and 0.98+°;;;^, Ob/i^ = 0.026+°;°^° and 
0.029 and n = 1.02+^;-^q and 1.18+o;23, all at the 
95% confidence level. 



6 DISCUSSION 

A comparison of the frequentist coufidence intervals and the 
Bayesian credible regions is shown in Figure 9. We have also 
included the results of Balbi et al. (2000), who set parame- 
ter confidence intervals using the same data set considered 
in this paper but use maximization rather than marginal- 
ization of the likelihood function. In this method the likeli- 
hood function for a parameter is determined by finding the 
maximum of the likelihood jC{a) as a function of the remain- 
ing parameters. When £(a) is Gaussian maximization and 
marginalization are equivalent. 

The central values and the widths of confidence inter- 
vals derived from all three methods give consistent results 
within about 15% and 30% respectively. A closer examina- 
tion suggests, however, that frequentist confidence intervals 
arc somewhat broader than the Bayesian ones. For five out of 
eight parameters (n, Qm, Oa, ft, and fts^^) the frequentist 
confidence intervals are somewhat larger than the Bayesian 
credible regions, and for Ho the intervals are nearly iden- 
tical. For the three parameters for which we have results 
from all three methods the Bayesian intervals are either the 
narrowest (fts/i^ and ft) or identical to maximization (n). 
Also, we find that the 99% frequentist confidence intervals 



arc somewhat wider than the 99% Bayesian credible regions 
for every parameter considered except fte- 

Despite this pattern which suggests that a frequentist 
analysis gives broader confidence intervals, it is difficult to 
claim such a pattern conclusively. Furthermore, it is not use- 
ful to quantify the pattern exactly because the difference in 
confidence interval widths is usually within one parameter 
grid point. Much finer gridding and hence a much larger 
database would be necessary to claim such a pattern with 
high confidence. A larger database would also provide a more 
accurate determination of the Ax^ functions in Figure 5, 
and the likehood functions in Figure 8. However, a larger 
database would have been computationally prohibitive. 

The difference between the confidence interval and cred- 
ible region for the baryon density fte/i^ is of some inter- 
est. Maximization (Balbi et al. 2000) and Bayesian (Jaffe 
et al. 2001) analyses of the MAXIMA- 1 and COBE data 
gave consistency between fte/i'^ from CMB measurements 
and a value of 0.021 from some determinations oi D/H from 
quasar absorption regions (O'Meara et al. 2001) only at the 
edge of the 95% intervals. This was interpreted as a tension 
between CMB measurements and either deuterium abun- 
dance measurements or calculations of BBN (Tegmark & 
Zaldarriaga 2000; Grifiiths, Silk & Zaroubi 2000; Cyburt, 
Fields, & Olive 2001b). A value of 0.021 for fts/i^ is con- 
sistent with the frequentist confidence interval at a level 
of 75%, an agreement at a confidence of just over la. Re- 
cent analysis of new CMB data is consistent with a value of 
fts/i^ = 0.021 within a la level (Pryke et al. 2001; Netter- 
field et al. 2001). 

The comparison between the Bayesian- and frequentist- 
based analyses raises the question of whether agreement at 
the level observed was in fact expected. The Bayesian and 
frequentist approaches to parameter estimation are concep- 
tually quite different. A Bayesian asks how likely a param- 
eter is to take on any particular value, given the observed 
data. A frequentist, on the other hand, asks how likely the 
given data set is to have occurred, given a particular set of 
parameters. Since the two questions axe completely different, 
there is no guarantee that they will yield identical answers in 
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general. In certain specific situations Bayesian and frequen- 
tist approaclies can be sliown to yield the same results. For 
example, in the particular case of Gaussian-distributed data 
with uniform priors and linear dependence of the predictions 
on the parameters, the two approaches coincide. However, 
these hypotheses (particularly the last one) do not apply to 
the case we axe considering. 

Bayesian and frequentist methods also coincide asymp- 
totically, i.e. in the limit as the number of independent data 
points tends to infinity (Ferguson 1996). In that limit, all 
confidence regions would be small in comparison to the 
prior ranges of the parameters, and the Bayesian prior- 
dependence would become negligible. CMB data are clearly 
not yet in this limit. 
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APPENDIX A: PROBABILITY DISTRIBUTION 
OF THE EXPERIMENTAL DATA 

BJK have shown that the band-powers are well- 
approximated by an offset log-normal distribution. Specif- 
ically, they showed that the probability distribution 
p{Zf I Zl) is approximately Gaussian as a function of Zl. 
Furthermore, it is possible to compute the covariance matrix 
of these Gaussian random variables. 

The calculation in BJK was performed in a Bayesian 
framework. For the frequentist analysis we need to know the 
probability distribution p{Zf \ Zj) as a function of Zf, not as 
a frmction of Zj . (This is the heart of the difference between 
the two approaches: for a Bayesian the data arc fixed and 
the theoretical quantities are described probabilistically; a 
frequentist treats the data as a random variable for fixed 
values of the parameters.) We therefore make the ansatz 
that the probability distribution is Gaussian in zf as well. 

If the zf are indeed Gaussian distributed, then the en- 
tries of the weight matrix M (inverse covariance matrix) 
should be exactly the same for independent observations 
of universes which have the same underlying CMB power 
spectrum. We test the assumption of Gaussianity using sim- 
ulations. We generate CMB maps using a particular cosmo- 
logical model, compute the power spectrum and M for each 
map and assess the variance in the entries of M between 
simulations. A small variance would indicate that the as- 
sumption that the Zf are Gaussian-distributed is adequate. 

We generated 100 small-area and 30 large-area map 
simulations using ao as the cosmological model and com- 
puted the M matrix for each map (the number of simu- 
lations is limited by the computational resources required 
to estimate the power spectrum for each map). The small- 
and large-area maps contain 542 and 5972 8' pixels respec- 
tively. Power spectra and Zi were computed in four bins 
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of I ={2,300},{301,600}, {601,900}, {901, 1500}, and M was 
obtained by marginalizing over the first and last bins. The 
results are summarized in Table Al. The average value of 
the diagonal entries increases for the larger-area maps be- 
cause for those the band powers have smaller errors and 
hence larger values in the weight matrix. The percent fluc- 
tuation in the matrix entries of the large-area maps are 2% 
for the first diagonal entry, 6% for the second diagonal en- 
try, and 2% for the off diagonal entries. We consider this 
variance to be small enough to indicate that the assumption 
of Gaussianity of the Zf is acceptable. We also note that 
the variance of the matrix elements decreases as a function 
of increasing map size. If such a trend continues to maps of 
the size of the MAXlMA-1 map, which has more than 15,000 
pixels, then the assumption of Gaussianity is well satisfied. 

This paper has been produced using the Royal Astronomical 
Society /Blackwell Science M^jK style file. 
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